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Abstract 

We characterize the structure of the periods of a neuronal recurrence 
equation. Firstly, we give a characterization of k-chains in 0-1 periodic 
sequences. Secondly, we characterize the periods of all cycles of some 
neuronal recurrence equation. Thirdly, we explain how these results can be 
used to deduce the existence of the generalized period-halving bifurcation. 

Keywords. Neuronal recurrence equation, cycle, period, generalized period¬ 
halving bifurcation. 

I Introduction 

The human brain can be viewed as a set of interconnected neurons. Caianiello 

II SI suggested to model the brain using the following threshold automata 
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network: 


n k 


xi(t + 1) = 1 ^ ^ ^ dij(s)xj(t + 1 — s) — 9, 
where: 


j =i s=l 


1 < i < n, t > k — 1 (1) 


Xj{t + 1 — s) is the state of the neuron j at time t + 1 — s, 

dij(s) represents the influence of the neuron j at time t + 1 — s on the neuron i at time t + 1, 
9i is the threshold of the excitation of the neuron i , 

]Cj=r Es=i a ij( s ) x j(t + 1 — s) is the potential of the neuron i at time t, 
n is the number of the neurons of the network, 
k is the size of the memory, 

1 [u] = 0 if it < 0, and 1 [m] = 1 if u > 0. 


The dynamics of this model has been studied in some particular cases: 

1. In the Equation (JT]), when k = 1, we obtain the following equation: 

n 

Xj(t + 1) = 1 ( y ajjXj(t) — Oj) 1 <i <n (2) 

3 = 1 

which models the dynamic behavior of n interconnected neurons of mem¬ 
ory size 1. These networks were introduced by McCulloch and Pitts [5], 
and are quite powerful. 

2. In the Equation ([1]), when n = 1, we obtain the following equation: 

x{n) = 1 a 3 x{n - j) - (3) 

introduced by Caianiello and De Luca [5] which models the dynamic be¬ 
havior of a single neuron with a memory, that does not interact with other 
neurons. 

Neural networks are usually implemented by using electronic components or 
are simulated by a software on a digital computer. One way in which the collec¬ 
tive properties of a neural network may be used to implement a computational 
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task is through the energy minimization concept. The Hopfield network is a 
well-known example of such an approach. It has attracted a wide attention in 
literature as a content-addressable memory [2]. 

Caianiello networks have been studied by Goles m and Ndoundam |18j . Many 
studies have been devoted to the McCulloch and Pitts’ neural networks 

Matamala m studied McCulloch and Pitts’ reverberation 
neural networks (i.e. neural networks of McCulloch and Pitts where each state 
of the system, after a finite number of steps comes back to itself, hypercube 
permutation). 

Cosnard, Moumida, Goles and T. de St. Pierre [B: showed the following 
result in the case of palindromic memory: 

Proposition 1 If the interacting coefficients (ai,a 2 ,--- ,a*,) verify 
ai = ak+i-i Vi £ N, 1 < i < k 
Then the length of each cycle is a divisor of k + 1. 


In the case of j-palindromic memory, they also showed: 

Proposition 2 JEf If the interacting coefficients ( 01 , 02 , • • • , 0 *,) are j-palindromic, 
i.e. verify 

• ai = 02 = • • • a,j = 0 

• a* = ak+j+i-i Vi £ N, j + 1 < i < k 

Then the length of each cycle is a divisor of k + j + 1. 


When the memory are geometric sequence, they showed the following result: 

Proposition 3 JE J/ If the interacting coefficients verify ai = ~{b l ) with b £ 
]0, i] Then the length of each cycle is less or equal to k + 1. 
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In the case of positive geometric sequence, they showed 


Proposition 4 JE/ If the interacting coefficients verify ai = (b l ) with b e]0, 
Then the length of each cycle is 1. 


Another results have been established on neuronal recurrence equations model¬ 
ing neurons with memory m ISHEEa Eg El EH ESI ESI . From the point of 
view of the period: 

• in B ganglia can, the authors didn’t study all the cycles generated 
by the neuronal recurrence equation; 

• in this paper, we are studying all the cycles generated by the neuronal 
recurrence equation {y{n) : n > 0}. 

From the point of view of bifurcation: 

• in |T9j, we studied the dynamics of the sequence {z(n) : n > 0} from one 
and only one initial configuration. We characterized only one cycle of 
the sequence {z(n) : n > 0}; 

• in |2I|, for any d ( 0 < d < p(m) — 1 ), we studied the dynamics of the 
sequence {z(n, d) : n > 0} from one and only one initial configuration. 
We characterized only one cycle of the sequence {z(n, d) : n > 0}; 

• in this paper, for any d ( 0 < d < p(m) — 1 ), we are showing how to 
study the dynamics of the sequence {z(n,d) : n > 0} from any initial 
configuration. We are showing how to characterize the length of all cycles 
of the sequence {z(n,d) : n > 0}. 

Our work, from some point of view, is similar to the work of Matamala m in 
the sense that we study all the periods. 
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The paper is organized as follows: in Section 2, some previous results are 
presented. Section 3 presents a characterization of k-chains in 0-1 periodic 
sequences. Section 4 is devoted to the characterization of the period length of 
all the cycles. In section 5, we study a bifurcation. Concluding remarks are 
stated in Section 6. 


2 Previous Results 

Given a finite neural network, the configuration assumed by the system at time 
t is ultimately periodic. As a consequence, there is an integer p > 0 called the 
period (or the length of a cycle) and another integer T > 0 called the transient 
length such that: 

• Y(p + T) = Y(T) 

• $ T' and p' (T',p') ^ (T,p) T>T'andp>p' such that Y(p' + T') = 
Y(T') 

where Y(t) = (x(t),x(t — 1),..., x(t — k + 2 ),x(t — k + 1)). The period and the 
transient length of the sequences generated are good measures of the complex¬ 
ity of the neuron. A bifurcation occurs when a small smooth change made to 
the parameter values (the bifurcation parameters) of a system, causes a sudden 
’qualitative’ or topological change in its behaviour. A period-halving bifurca¬ 
tion in a dynamic system, is a bifurcation in which the system switches to a new 
behaviour with half the period of the original system from some initial configu¬ 
ration. A generalized period-halving bifurcation is a period-halving bifurcation 
from any initial configurations. 

Cosnard, Tchuente and Tindo [7j show the following lemma: 

Lemma 1 [7/ 

If there is a neuronal recurrence equation with memory length k that generates 
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sequences of periods pi,P 2 , ■ ■ ■ ,Pr, then there is a neuronal recurrence equation 
with memory length kr that generates a sequence of period r x lcm(pi, ■ ■ ■ ,p r )- 


Lemma Q] does not take into account the study of the transient length. One can 
amend Lemma [T] to obtain the following lemma: 

Lemma 2 fSTj If there is a neuronal recurrence equation with memory length k 
that generates a sequence {x J (n) : ro > 0} , 1 < j < g of transient length T 3 and 
of period p 3 , then there is a neuronal recurrence equation with memory length 
kg that generates a sequence of transient length g x max(Ti,T 2 , ..., T g ) and of 
period Per. Per is defined as follows: 

First case: 3 j, 1 < j < g such that p 3 > 2 

Per = g x Icmfpi, ■ ■ ■ 7 p g ). 

Second case: pj = 1 ; V j, 1 < j < g. 

Per is a divisor of g. 


Cosnard and Goles [8] studied the bifurcation in two particular case of neu¬ 
ronal recurrence equations. 

Case 1: Geometric coefficients and bounded memory 

Cosnard and Goles completely described the structure of the bifurcation of the 
following equation: 

/ fe-i 

x n _i_i = 11 (9 ^ ^ b x n —i 

\ i= 0 

when 9 varies. They showed that the associated rotation number is an increas¬ 
ing number of the parameter 9. 
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Case 2: Geometric coefficients and unbounded memory. 


Cosnard and Goles completely described the structure of the bifurcation of 
the following equation: 

f n 

%n- f-1 = 1 I 9 ^ ' b X n _i 

V i=0 

when 9 varies. They showed that the associated rotation number is a devil’s 
staircase. 

The next section is devoted to the study of k-chains. 


3 Characterization of k-chains in 0-1 periodic 
sequences 

We recall the concept of k-chains in 0-1 periodic sequences [I] which is useful in 
the study of the limit orbits. Let Y = ( y(t ) : t £ N) be a periodical sequence 
of 0 ’s and l’s; suppose that the period 7 (Y) ( which is a priori unknown ) di¬ 
vides T. Thus y(t) £ {0, 1} for any t £ Z and y{t) = y(t') when t = t' (mod T). 
In studying period lengths, we shall deal with sets invariant under translations [Tj, 
so the following notation will be useful: if T C Zt : l £ Z, we write: 

T + l = { t +1 ( mod T ) : t £ T} 

Let us partition the set Z t into r°(l r ) = { t £ Zt : y(t) = 0} and 

T 1 (T) = {t £ Zt ■ y(t) = 1} which is called the support of Y. The period 
of the set T 1 (Y) is the smallest positive number 7 such that r 1 (Y)+7 = T 1 (Y). 
The following result was established in pQ : the period of the sequence (i.e. q(Y) 
) is equal to the period of T 1 (Y). It is shown in [T| that: 

7 (Y) divides k if and only if T 1 (Y) + k = T 1 (Y) 
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Now let us define k-chains ( for k > 1 ) contained in the support r 1 (F). A 
subset C C r 1 (l r ) is called a k-cliain if and only if it is of the form C = 
{ t + kl ( mod T) : 0 < / < s — 1} for some s > 1. So a k-cliain is a subset 
C = { t + kl 6 Z t '■ 0 < l < s — 1 } such that y(t r ) = 1 for any t' 6 C. 

We characterize the 0-1 sequence which contains two different chains. 
Lemma 3 If a 0-1 sequence {u(n) : n > 0} contains: 

• an chain, 

• an £ 2 -chain, 

• such that £i and £2 ore relatively prime. 

Then 

3 t £ N such that: 

• u{t) = 1, 

• u{t + £ 1 ) = 1, 

• u(t + £ 2 ) = 1. 


We use the lemma [3] to characterize all the periods of all the attractors. 


4 Characterization of the periods of all the cy¬ 
cles 

Let us consider a positive integer m and a positive real number 0 > 2m, we 
note: 
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Notation 1 


• PoiPi,--- ,Ps- 1 are prime numbers taken between 2 m and 


3 to such that pi < Pi+i, 


• a,; = 3m — pi, 0 < i < s — l, 


• k = 6m, 


and we define the coefficients as follows: 


coe/i(j) = < 


(9/2) —ai if j = 3m —ai, 0< i < s — 1; 

(9/2) + cti if j = 2(3 m — cti), 0 < i < s — 1; (4) 

—k(9 + m) otherwise. 


The coefficients defined in Equation (Jd]) are analog to those defined in [23]. 
For each i, 0 < i < s — 1, the first k terms of the sequence {x ai (n) : n > 0} 
are defined as follows: 


sc“* (0)af“* (!)--■ ar“* (/s — 1) 


po...oioo ; ..oioo^..o 

2 oti 3m—oti 3 m—OLi 


(5) 


V n > k, the term x ai (n ) of the sequence {x ai (n) : n G N} is defined as 
follows: 

k 

x ai (n) = 1(7; coefi(i)x ai (n — i) — 9) 

i= 1 

By using the technique developped by Tchuente and Tindo [23], it is easy to 
prove the following lemma: 


Lemma 4 The sequence {x ai (n) : n £ N} describes a cycle of length 3m — cn 
of the following form: 


00 ... 0100 ... 0100 ... 0100 ... 0 100 ... 0 • ■ 


3 m—a.i 


3 m—a.i 


3m—oti 


3m—oti 


In [23], the authors didn’t study all the cycles generated by the neuronal 
recurrence equation. One of our aims is to study all the cycles generated by 
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some neuronal recurrence equation. 


We construct the sequence {u(n) : n > 0} generated by the neuronal 

recurrence equation 

k 

u(n) = l(^2coef!(j)u(n - j) - 6>) , n>k (6) 

3 =1 

such that the initial terms are defined as follows: 

u(0)u(l) • • • u(k — 1) e {0, l} fc . (7) 

Let us characterize the period of the sequence {u(n) : n > 0} by showing 
the following proposition: 

Proposition 5 The sequence {u(n) : n > 0} converges 

• to the null sequence i.e. to 0 0 • • • 0 0 • • • 0 0 • • • , or 

• to one of the sequences {x ai (n) : n > 0 } , 0 < i < s — 1 . 


Example: In the aim to give an idea of the basin of attraction of the sequence 
{u(n) : n > 0 }, we choose the following parameters: 

m = 5, 0 = 12, po = 11, pi = 13, and k = 30. 


We build from the preceding parameters the following neuronal recurrence equa¬ 


tion 


where: 


u{n) 


1 (5Z coe /i0'M n , n> 30 

j =i 


coefi(j) = < 


2 , if J = 11 

4, if j = 13 

10 , if j = 22 
8 , if j = 26 

—510 , otherwise. 


( 8 ) 


(9) 
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Let us note: 


config(i) = { u(0)u(l) • • • it(28)u(29) : Vi, 0 < i < 29 , u(i) G {0,1} 
and the neuronal recurrence equation defined by equation© from the 
initial terms zi(0)u(l) • • • u(28)u(29) converges to a cycle of length i }. 

We also note x{i) = card{config(i )). By numerical simulations, the values of 
the sequence xOO are: 


X(i) =0 if i £ {1, 11, 13} 
X(l) = 1073713157 
X(H) =4094 
X(13) = 24573. 


Notation 2 Let us define the memory length of some neuronal recurrence equa¬ 
tions as follows: 


h = s x k = 6m x s. 


Let {y(n) : n > 0} be the sequence whose first h terms are defined as follows: 


y(i) G {0,1}, 0 <i < -1 + h, 


( 10 ) 


and the other terms are generated by the following neuronal recurrence equation: 



( 11 ) 


where 




otherwise. 


( 12 ) 


(13) 


The parameters coefi(j) are those defined in Equation ©. 
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Remark 1 (a) The first h terms of the sequence { y(n ) : n > 0} are obtained 
by taking any element of the set { 0 , l} h . 

(b) The coefficients coe/ 2 (/) of neuronal recurrence Equation ill]) are obtained 


by applying the construction of Lemma\7\ to the parameters defined by Equation 

©■ 


Our aim is to characterize the structure of all the periods of the sequence y[n) 
from a qualitative point of view. The next theorem gives the period of the 
sequences {y(n) : n > 0}. 

Theorem 1 From any initial term, the sequence {y{n) : n > 0} converges to 
a cycle of length : 

• s x lcm(elti,elt 2 , ■ ■ ■ ,elt s ) where elti £ {po,pi, ■. ■ ,p s -ij for any i £ 


{ 0 , l, 2 ,...,s- 1 }, or 


• p where p is equal to 1 . 

■ 

In the next section, we show how to apply the previous technique to the 
study of bifurcation of the neuronal recurrence equation z(n,d). 

5 Generalized Bifurcation of the neuronal recur¬ 
rence equation 

Let us define the neuronal recurrence equation {5i(n) : n > 0 } by the 

following recurrence: 



( 14 ) 
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where coef 3 (j) is defined as follows: 


First case: s is even and V i 2 £ N, 0 < i 2 < s — 1 


coef 3 (j) = 


2 

-2 


if j £ i?l(«i 2 ) and j < 3X6Xpi2 ( 
if j £ i?l(aj 2 ) and j > 3xa ^ p ‘ 2 , 


—4 x k 2 otherwise. 

Second case: s is odd, s > 3 and V i 2 £ N, 0 < i 2 < s — 1 


( 15 ) 


coef 3 (j) = < 


2 

-2 

-1 

— 4 X &2 


if j £ l?l(ai 2 ) and j < ( - 3x ^ 1 x pi 2 , 

if j £ Rl(a i2 ) and (3x ^ )+1 x p i2 <j< (2s - 2) x p i2 , 

if j £ {( 2 s - 1 ) x p i2 , 2 sxp, 2 } , 

otherwise. 

(16) 


The parameters R\{a.i), 6 and k 2 are defined as follows: 


Rl(a i ) = {jp i :j = l,...,2s} (17) 

= {pi,2pi,... ,(-l+ 2s)pi,2 x s x pi}, 0 <i < —1 + s; (18) 
R2 = {i: i = 1,..., k 2 } = {1,2,..., -1 + k 2 , k 2 }\ (19) 

-l+s 

R3= (J Rl(ai)- (20) 

i=0 

RA = R2\R3; (21) 

0 = 2 x s; (22) 

k 2 = (6m — 1) x s. (23) 


By applying the technique developped in sections 2 and 3, and the one 
developped in m to the neuronal recurrence equation defined by Equation (ThU) , 
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it is easy to construct a family of neuronal recurrence equations {z(n,d) : n > 0} 
which verify the following theorem. 

Theorem 2 Vm, d G N such that m > e 2 and 0 < d < s — 2, we construct a set 
of neuronal recurrence equations whose behaviour has the following characteris¬ 
tics: 

• From any initial configuration, the neuronal recurrence equation {z(n,d) : 
n > 0 } converges to a cycle of length s x lcm(elti, elt- 2 ,..., elt s ) where 
elU G {p d +i,Pd+ 2 ,---,Ps-i} for any i G {1,2, . ..,s} ; or to a cycle of 
length 1. 

• From any initial configuration, the neuronal recurrence equation { z(n , s — 
1 ) : n > 0 } converges to a fixed point (i.e. the period of a cycle is 1). 


In other words, the first part of Theorem [2] can be interpreted as follows: 
in some cases, the length of the cycles of the neuronal recurrence equation 
{z(n,d — 1 ) : n > 0 } is divided by pd to obtain the length of cycles of the 
neuronal recurrence equation {z(n,d) : n > 0 }. 

By perturbation, we can build the neuronal recurrence equation {z(n, d) : n > 0} 
from the neuronal recurrence equation {z(n, d — 1 ) : n > 0 }. 

Remark 2 The new contributions in this paper with respect to the previous 
works are: 

Firstly, from the point of view of the period: 

• in US ;Z 3 [T? | \20f , the authors didn’t study all the cycles generated 

by the neuronal recurrence equation; 

• in this paper, we studied all the cycles generated by the neuronal re¬ 
currence equation {yin) : n > 0 }. 
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Secondly, from the point of view of bifurcation: 


• in m, we studied the dynamics of the sequence {z(n) : n > 0 } from one 
and only one initial configuration. We characterized only one cycle of 
the sequence {z(n) : n > 0}; 

• in m, for any d ( 0 < d < p{m) — 1 ), we studied the dynamics of the 

sequence {z(n,d) : n > 0 } from one and only one initial configuration. 

We characterized only one cycle of the sequence {z(n, d) : n > 0}; 

• in this paper, for any d ( 0 < d < p{m) — 1 ), we studied the dynamics 

of the sequence {z(n,d) : n > 0} from any initial configurations. We 

characterized the length of all cycles of the sequence { z(n,d) : n > 0 }. 

6 Conclusion 

We have given a characterization of k-chains in 0-1 periodic sequences. This 
characterization allows us to determine the periods of all cycles of some neu¬ 
ronal recurrence equations. From the structure of the periods of all cycles, we 
show how to build the family of neuronal recurrence equation {z(n, d) : n > 0 } 
which admits a generalized period-halving bifurcation. The structure of the con¬ 
figuration of neuronal recurrence equation can be used in steganography (see 
Second Approach and Third Approach of the paper [22]). 
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Appendix 

Proof of Lemma [3] 

From the hypothesis, the sequence {u(n) : n > 0} contains two chains, we can 
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deduce that: 


• 3a £ N , 0 < a < £\ 

• 36 £ N , 0 < 6 < (-2 

• u(a + {i x £ i)) = 1 , Vz £ N 

• u(b + (jx£ 2 )) = 1 , Vj £ N 

By hypothesis, integers t\ and £2 are relatively prime and from the definition 
of greatest common divisor, we can deduce: 


3 m, ri 2 £ Z such that m x l\ + n 2 x £2 = 1 (24) 

From Equation (El) , we can easily deduce: 

ni x (b — a) x £1 + n 2 x (b — a) x £2 = b — a (25a) 

a + («i x (b — a) x £\) = b — (n 2 x (b — a) x £ 2 ) (25b) 

From Equation (125bl) . it follows that 3 z 0 , j 0 £ N defined as follows: 

z 0 = ni x (b — a) + ((l+ | rn{b — a) \ + \ n 2 {b — a) | ) x£ 2 J (26a) 

jo = — «2 x (b — a) + ((l+ | ni (6 — a) | + \ n 2 (b — a) | ) x£^ (26b) 

such that: 

a + (»o x £ 1 ) = b+(j 0 x£ 2 ) 

It suffices to choose f = a+(ioxb). 


Proof of Proposition [5] 

Without loss of generality, let us choose the following initial terms 
zz( 0 )zz(l)zz( 2 ) • • • u(k — 1 ) £ ( 0 , l} fc . 
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We suppose that from the following initial terms 


u(0)u(l)u(2) ■ ■ ■ u(k — 1 ) € (0, l} fc 

the sequence {u(n) : n > 0} describes a transient of length T) and a cycle of 
length Pi. We define the sequence {w(n) : n > 0} as follows: 

V n € N w(n) = u(n + T\). 

In others words, the sequence {u(n) : n > 0} converges to the attractor 

{w(n) : n > 0}. The proof is divided into two parts: 

Firstly, let us suppose that the sequence {w(n) : n > 0} is not equal to one of 
the following two sequences: 

• to the null sequence i.e. to 00---000--- 

• to one of the sequences {x ai (n) : n > 0} , 0 < i < s — 1. 

We can extract from the sequence {w(n) : n > 0} an £-chain such that : 

l zfc 0 mod pi ,0 < i < s — 1. (27) 

Without loss of generality, let us assume that: 

w{ti) = 1 (28) 

from the fact that the sequence { w(n ) : n > 0} admits an t'-chain, we can 

deduce that: 

w{ti+i) = 1. (29) 

From Equation (1271) . we can easily deduce that: 

coefi(l) = —k(0 + m). (30) 


From the fact that: 

• w{i + ti) = l(J2'j=i coe h(j) w (t + ti -j) -0), 
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• coefi (£) = —k(6 + m), 

• w(ti) = 1 . 

We deduce that : iu(£ + t\) = 0. It follows that we have a contradiction 

with Equation (1751) . We can deduce that there is no tbchain in the sequence 
{w(n) : n > 0} that verifies Equation (1271) . 

Secondly, let us suppose that on the sequence {ul(n) : n > 0}, there exist 
at least two different chains. 

Without loss of generality, let us suppose that there exist on the sequence 
{w(n) : n > 0} : 

• an td-chain such that £\ = pn ,0 < il < s — 1 ; 

• an ^ 2 -cliain such that £2 = Pi 2 ,0 < i2 < s — 1; 

• h < h , he. pn < pi2. 

From the fact that the sequence {w{n) : n > 0} admits two chains : £\- 
chain and ^ 2 -chain, we deduce by application of Lemma[3]that there exist t.\ £ N 
which verifies: 


w(ti) = 1; (31a) 

w(ti + £i) = l; (31b) 

w(ti+ £ 2 ) = 1- (31c) 

We have : 2 x m < pn < pi 2 <3 x to. It follows that: 

1 = £ 2 —£i = Pi 2 -Pn < m. (32) 

From Equation (H]) and Equation (1571) . we deduce that: 
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coefi(i) = — k(9 + to ) 


( 33 ) 


Based on the facts that: 

• w(t\ + 1\) = 1 , 

• coefi(i) = —k(6 + m ), 

• w(ti + i 2 ) = 1 (EjU c °efi{j)w(ti +e 2 ~ j) ~ 0) • 

We deduce easily that w[t\ +l 2 ) = 0. This is a contradiction with the Equation 
(I31cl) . We easily deduce that the sequence {w(n) : n > 0} contains one and 
only one chain. 


Proof of Theorem |T] 

Based on Lemma [2] and Proposition [5] we deduce the result. 
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